Image processing device and image processing method

ABSTRACT

An image processing device that includes a highlight extracted video creation unit that creates a highlight extracted video based on extraction of a highlight from each video file of a plurality of video files and a highlight extracted video storage unit that stores the highlight extracted video as one data file.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 13/325,208, filed Dec. 14, 2011, which claims thebenefit of Japanese Priority Patent Application 2010-290445 filed Dec.27, 2010. Each of the above-referenced applications is herebyincorporated herein by reference in its entirety.

BACKGROUND

The present disclosure relates to an image processing device, an imageprocessing method, and a program.

In the past, in Japanese Unexamined Patent Application Publication No.2007-134770, for example, there is a description regarding a techniqueto determine an important scene in parallel with a process of filming avideo image and to generate important scene identification informationto record it.

SUMMARY

However, with the technique described in Japanese Unexamined PatentApplication Publication No. 2007-134770, after determining an importantscene, a user was not able to create a file including the importantscene.

It is desirable to provide an image processing device, an imageprocessing method, and a program that are new and improved and also arecapable of extracting a highlight video from a plurality of video filesand sharing it among a plurality of users.

According to an embodiment of the present disclosure, there is providedan image processing device, including: a highlight extracted videocreation unit creating a highlight extracted video, by obtaining aplurality of video files, obtained by extracting a highlight of eachvideo file; and a highlight extracted video storage unit storing thehighlight extracted video as one data file.

The image processing device may also further include a highlightextracted video file output unit outputting the data file.

In order to upload the data file via a network, the highlight extractedvideo file output unit may also output the data file to a device capableof being connected to the network.

In order to upload the data file via a network, the highlight extractedvideo file output unit may also output the data file.

In order to record the data file in a disk form recording medium, thehighlight extracted video file output unit may also output the highlightvideo to a recording unit of the disk form recording medium.

The image processing device may also further include: a scenariocreation unit creating a scenario of the highlight extracted video; anda scenario storage unit storing the scenario.

The image processing device may also further include an index creationunit creating an index of the data file created in past. The highlightextracted video file output unit may output a data file specified by auser from the index among the data file created in the past.

The image processing device may also further include a highlightextracted video reproduction unit reproducing the highlight extractedvideo.

According to another embodiment of the present disclosure, there isprovided an image processing method, including: creating a highlightextracted video, by obtaining a plurality of video files, obtained byextracting a highlight of each video file; and storing the highlightextracted video as one data file.

According to still another embodiment of the present disclosure, thereis provided a program causing a computer to execute a process including:creating a highlight extracted video, by obtaining a plurality of videofiles, obtained by extracting a highlight of each video file; andstoring the highlight extracted video as one data file.

According to an embodiment of the present disclosure, it is possible toprovide an image processing device, an image processing method, and aprogram that are capable of extracting a highlight video from aplurality of video files and sharing it among a plurality of users.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an outline of processing in animaging device according to an embodiment of the present disclosure;

FIG. 2 is a block diagram showing a configuration example of the imagingdevice;

FIG. 3 is a block diagram illustrating a process flow to create ahighlight video extracted file based on display contents on a displayunit;

FIG. 4 is a block diagram illustrating a process flow to create ahighlight video extracted file based on display contents on the displayunit;

FIG. 5 is a block diagram illustrating a highlight reproduction settingprocess; and

FIG. 6 is a flowchart showing a process procedure by the imaging device.

DETAILED DESCRIPTION OF EMBODIMENTS

A detailed description is given below to a preferred embodiment of thepresent disclosure with reference to the attached drawings. In thepresent specification and the drawings, a repetitive description isomitted by assigning an identical reference numeral to components havinga substantially identical functional configuration. The description isgiven in the following order.

-   1. Outline of an Embodiment-   2. Configuration Example of Imaging Device-   3. Specific Processing in Imaging Device-   4. Process Flow by Imaging Device

1. Outline of an Embodiment

Firstly, based on FIG. 1, a description is given to an outline ofprocessing in an imaging device 100 according to an embodiment of thepresent disclosure. Although a description is given with an example ofthe imaging device 100 having an imaging function as an image processingdevice in the embodiment, the image processing device is not limited tothis and the image processing device may also be various devices, suchas a personal computer and a mobile phone. FIG. 1 is a block diagramillustrating an outline of processing in the imaging device 100.

The imaging device 100 according to the embodiment is, as one example, adevice such as a video camera. The imaging device 100, as shown in FIG.1, records a plurality of filmed video data items (video files). In FIG.1, a chapter #1, a chapter #2, a chapter #3, . . . , a chapter #Nillustrate a plurality of video files, respectively. The video files arenot limited to video images and may also be still images.

As shown in FIG. 1, the imaging device 100 can create a highlight videoin which major scenes are collected from each of the plurality of videofiles for reproduction. The imaging device 100 can record the createdhighlight video. As shown in FIG. 1, a highlight video is extracted fromeach video of the chapter #1, the chapter #2, the chapter #3, . . . ,the chapter #N and can be reproduced as a highlight extracted video.From the highlight extracted video composed of the plurality ofhighlight videos, one video file (hereinafter, referred to as ahighlight video extracted file) is created.

The highlight video extracted file thus created can be uploaded on theweb in response to an instruction of a user. The highlight videoextracted file can also be recorded in a recording medium, such as aDVD, in response to an instruction of a user. In such a manner, onehighlight video extracted file in which a plurality of highlight videosis collected is created and stored, thereby enabling a user to view ahighlight video only from a large number of video files.

2. Configuration Example of Imaging Device

Next, a configuration of the imaging device 100 according to theembodiment is described. FIG. 2 is a block diagram showing aconfiguration example of the imaging device 100. As shown in FIG. 2, theimaging device 100 is configured to have an imaging unit 110, anoperation input unit 120, a control unit 130, a memory unit 150, and adisplay unit 160.

The imaging unit 110 includes an imaging element, such as a CCD sensorand a CMOS sensor. The imaging element photoelectrically converts asubject image formed on the imaging surface by an imaging optical system(not shown). The imaging unit 110 A/D converts a video signal obtainedby photoelectric conversion to output it as video data to the controlunit 130.

The operation input unit 120 is an operational member, such as a buttonand a switch, operated by a user. The user can carry out a desiredoperation by operating the operation input unit 120 while referring to adisplay on the display unit 160. As one example, a user can carry out anoperation of pressing down a button by pointing a cursor at a positionof a button displayed on the display unit 160 and pressing the operationinput unit 120. In a case that the display unit 160 is provided with atouchscreen type sensor, the operation input unit 120 is equivalent to atouchscreen. In this case, a user can carry out a desired operation byoperating the touchscreen while referring to a display on the displayunit 160.

The memory unit 150 is, as one example, configured with a memory, suchas a hard disk. To the memory unit 150, the video data is sent from thecontrol unit 130. The memory unit 150 memorizes the video data sent fromthe control unit 130 and stores it therein. In the memory unit 150, aprogram to be executed in the control unit 130 is memorized.

The display unit 160 is configured to include a liquid crystal displayand the like, and carries out a display based on video data sent fromthe control unit 130.

The control unit 130 is configured to have a highlight extractionsetting unit 132, a highlight extracted video creation unit 134, ascenario creation unit 136, a highlight extracted video reproductionunit 138, a highlight extracted video storage unit 140, a file outputunit 142, and an index creation unit 144. Each component of the controlunit 130 shown in FIG. 2 can be configured with hardware (circuit) or acentral processing unit (CPU), and software (program) to function it. Inthis case, the program can be stored in the memory unit 150.

The highlight extraction setting unit 132 carries out various settingsregarding the highlight extracted video based on an instruction of auser inputted to the operation input unit 120. As described later indetail, in the embodiment, as one example, it is possible to set sixitems of “range”, “theme”, “BGM”, “length”, “sound mixing”, and “pointspecification” regarding the highlight video extracted file.

The highlight extracted video creation unit 134 obtains a video filestored in the memory unit 150 for every one or a plurality of events tocreate a highlight video of the obtained video files. Then, thehighlight extracted video creation unit 134 creates one highlightextracted video from the plurality of highlight videos. When thehighlight extracted video is created, the scenario creation unit 136creates a scenario thereof. Here, a scenario is information showing howmuch time of a video is retrieved in the highlight extracted video fromwhich video file.

The highlight extracted video reproduction unit 138 carries outprocessing to reproduce a highlight extracted video. The highlightextracted video reproduction unit 138 sends data of a highlightextracted video to the display unit 160 in a case of reproducing thehighlight extracted video. With this, the highlight extracted video isreproduced in the display unit 160.

The highlight extracted video storage unit 140 carries out processing tomake the highlight extracted video into one data file (highlight videoextracted file) for storage. With this, the highlight extracted video isstored in the memory unit 150 as one data file.

The file output unit 142 outputs the one data file created by thehighlight extracted video storage unit 140 to upload it on the web or tocreate a DVD. The index creation unit 144 creates an index of ahighlight video extracted file created in the past. The created index isdisplayed on the display unit 160. By selecting a desired file from theindex displayed on the display unit 160, a user can reproduce a desiredvideo file and also upload it on the web and create a DVD.

3. Specific Processing in Imaging Device

FIGS. 3 and 4 are block diagrams illustrating process flows to create ahighlight video extracted file based on display contents of the displayunit 160. In the embodiment, a video file can be created from “an eventview (screen 2 a)” or “a map view (screen 2 b)”. In the “event view”, aplurality of video files is recorded for every event, and one highlightvideo extracted file can be created from the plurality of video files.For example, in a case of a travel event, a video filmed on the trainbefore reaching the destination, a video filmed at the destination, andthe like are recorded as a plurality of video files, and it is possibleto create one highlight video extracted file from these video files. Ina case that a user specifies a plurality of events, it is possible tocreate one highlight video extracted file from videos of the pluralityof events.

In a case of the “map view”, when a plurality of video files filmed neara certain spot A is recorded, it is possible to create one highlightvideo extracted file from the plurality of video files by specifying thespot A. In a case that a user specifies a plurality of spots, it ispossible to create one highlight video extracted file from a pluralityof videos filmed near the plurality of spots.

When creating the highlight video extracted file, firstly, a highlightextracted video is reproduced. Then, in a case that the user likes thehighlight extracted video and would like to create a highlight videoextracted file, it is possible to create a highlight video extractedfile by carrying out processing for that.

As shown in FIG. 3, a user can have either the “event view” or the “mapview” displayed (screens 2) from a menu screen (screen 1) to specifyeither view that creates a highlight video extracted file. Then, afterspecifying the “event view” or the “map view”, he/she browses on abrowser screen and selects video files to create a highlight image.

In a case of the “event view”, one or a plurality of events to create ahighlight video extracted file is selected. In addition, in a case ofthe “map view”, one or a plurality of spots to create the highlightvideo extracted file is selected. Then, by pressing a highlightreproduction button, the highlight extracted video is created andhighlight reproduction is carried out (screen 3).

During reproduction or after reproduction of the highlight extractedvideo, a user can press any button of “view once again”, “store toshare”, “highlight reproduction settings”, and “store scenario” to carryout these processes (screen 4, screen 5). For example, in a case ofpressing the “view once again” button after reproducing the highlightextracted video, it is possible to view the highlight extracted videoonce again. In a case of pressing the “store to share” button, thehighlight extracted video can be stored as one highlight video extractedfile to move onto a process of uploading it on the web or creating a DVDso as to allow a plurality of users to share it. These processes aredescribed later in detail. In a case of pressing the “store scenario”button, the highlight video extracted file itself is not stored but ascenario of the highlight extracted video is stored.

A user can carry out a scenario reproduction process based on an alreadystored scenario. In this case, a user enters a scenario reproductionscreen (screen 6) from the menu (screen 1) and presses a “scenarioreproduction” button. With this, a highlight extracted video is createdfrom the scenario to carry out reproduction. After reproduction, bypressing any of the “view once again”, “clear scenario”, and “store toshare” buttons (screen 7, screen 8), it is possible to go on to asubsequent process.

A user can specify a highlight video extracted file created in the pastand stored in the memory unit 150 for reproduction. In this case, a userhas a highlight video image catalog (index) displayed (screen 9) fromthe menu screen (screen 1) to specify a desired highlight videoextracted file that is stored. With this, a user can reproduce ahighlight video extracted file created in the past (screen 10), and thenby selecting a function of execution, he/she can upload it on the web orcreate a DVD to share it (screen 11).

FIG. 4 is a block diagram illustrating processes of storing a highlightvideo extracted file to share in a case that the “store to share” buttonis pressed in the screens 4, 5, 7, and 8 shown in FIG. 3. As a userpresses the “store to share” button, a screen 21 shown in FIG. 4 isdisplayed, and further as selecting an “OK” button, the reproducedhighlight extracted video is stored in the memory unit 150 as onehighlight video extracted file. This enables a highlight video extractedfile to be stored as one file of work piece.

After storing the highlight video extracted file, the screen 22 isdisplayed, and as a user selects “share”, a screen (screen 23) to selectwhether to upload it on the web or to create a DVD. In a case that auser selects “web upload” on the screen 23, a message of connecting theimaging device 100 and a personal computer with a USB cable is displayed(screen 24). A user can connect the imaging device 100 to a personalcomputer to upload the highlight video extracted file on the web.

In a case that the imaging device 100 has a function to connect to anetwork, such as the Internet, the imaging device 100 does not have tobe connected to a personal computer, and it is possible to directlyupload from the imaging device 100 on the web.

In a case that a user selects “create DVD” on the screen 23, a messageof connecting the imaging device 100 and a DVD recording device isdisplayed (screen 25). A user can connect the imaging device 100 to aDVD recording device to record a highlight video extracted file on aDVD. In a case that the imaging device 100 is provided with a DVDrecording device, a highlight reproduction video can be recordeddirectly on a DVD.

Next, based on FIG. 5, a highlight reproduction setting process isdescribed. A screen 2 a shown in FIG. 5 illustrates an event viewsimilar to the screen 2 a in FIG. 3. A user can carry out varioussettings on a highlight extracted video by moving onto a screen (screen31) of highlight reproduction settings to operate the screen 31. Here,as user configurable items, six items of “range”, “theme”, “BGM”,“length”, “sound mixing”, and “point specification” are shown as anexample. The “range” is an item to set a number of event(s) (in a caseof the event view) or a number of date(s) (in a case of the map view) tocreate a highlight extracted video. A user can set whether to create ahighlight extracted video from a video of one event (or date) or tocreate a highlight extracted video from two or more events (or dates).

The “theme” is an item to set an effect of an image. As one example, auser can select a desired item from the items, such as “active”,“stylish”, and “simple”, for setting. The “BGM” is an item to set amusic played in the background. A user can set a desired tune as the“BGM”. The “length” is an item to set a temporal length of a highlightextracted video. Here, as one example, the temporal length of ahighlight extracted video is supposed to be adjustable to lengths infour stages. The “sound mixing” is an item to determine a ratio ofvolumes of the BGM and an actual sound. The “point specification” is anitem to set a position of a highlight video in an original video file.

Similar to FIG. 3, by instructing highlight reproduction from the screen2 a, a highlight extracted video is created and reproduced (screen 3).On the screen 3, by selecting “edit” while reproducing a highlightextracted video, a scenario of the highlight extracted video can bestored. As described above, a scenario is information showing how muchtime of a highlight video is retrieved from which video file to thehighlight extracted video. In such a manner, by storing a scenario, whenselecting a stored scenario, a highlight extracted video can bereproduced based on the scenario.

As the highlight reproduction is finished, as described in FIG. 3, ascreen to select “view once again”, “highlight reproduction settings”,and “store to share” is displayed (screen 4). In a case of carrying outhighlight reproduction settings again, settings can be carried out againby selecting “highlight reproduction settings”.

From each screen of event browsing shown in FIG. 5, regarding each ofthe event view (screen 2 a) and the map view (screen 2 b), a user canhave an index displayed (screens 41, 42) and reproduce each video filenormally (screens 43, 44).

4. Process Flow by Imaging Device

FIG. 6 is a flowchart showing a process procedure by the imaging device100. Firstly, in step S100, a user specifies an event view or a map viewto instruct highlight reproduction, thereby creating a highlightextracted video to be reproduced. Next, in step S104, it is determinedwhether or not to store the highlight extracted video as one highlightvideo extracted file. In step S104, in response to an operation of auser, it is determined whether or not to store the highlight videoextracted file. It is also possible to store a scenario of the highlightextracted video after step S100.

In a case of storing the highlight video extracted file in step S104,the procedure goes on to step S106. In contrast, in a case of notstoring the highlight video extracted file in step S104, the process isfinished. In step S106, the reproduced highlight extracted video isstored as one highlight video extracted file. In step S108 that follows,it is determined whether or not to share the highlight video extractedfile. In step S108, in response to an operation of a user, it isdetermined whether or not to share a highlight video extracted file.

In a case of sharing the highlight video extracted file in step S108,the procedure goes on to step S110. In contrast, in a case of notsharing the highlight video extracted file, the process is finished. Ina case of going on to step S110, in response to an instruction of auser, it is determined whether to upload the highlight video extractedfile on the web or to create a DVD. In a case of uploading on the web,the procedure goes on to step S114, and after connection to a network isdone, the highlight video extracted file is uploaded on the web. Incontrast, in a case of creating a DVD, the procedure goes on to stepS112 to create a DVD. After step S112 or S114, the process is finished(END).

In a case of sharing the highlight video extracted file selected fromthe highlight video image index and reproduced, the highlight videoimage catalog (index) is firstly displayed in step S101 and the desiredhighlight video extracted file that is stored is specified, and thenreproduction of the highlight extracted video is carried out in stepS100. In a case of storing a highlight video extracted file fromscenario reproduction, after the scenario reproduction in step S102, itis determined in step S104 whether or not to store the reproducedhighlight extracted video as one highlight video extracted file.

As described above, according to the embodiment, since a highlight videoextracted file can be stored in one data file, it is possible to easilycarry out processes, such as uploading a highlight reproduction video onthe web and creating a DVD of the highlight reproduction video. It alsobecomes possible to select an already created highlight video extractedfile to be reproduced. Further, by storing a scenario of a highlightextracted video, a highlight extracted video can be reproduced from thescenario and a highlight video extracted file can also be created afterthe reproduction. Accordingly, it becomes possible to significantlyenhance the convenience of a highlight reproduction video.

Although a preferred embodiment of the present disclosure has beendescribed in detail with reference to the attached drawings, embodimentsof the present disclosure are not limited to such an example. It isapparent that a person with ordinary knowledge in the art of embodimentsof the present disclosure can appreciate various modifications oralterations within the technical ideas according to embodiments of thepresent disclosure, and naturally these are understood to belong to thetechnical scope of embodiments of the present disclosure.

The present disclosure contains subject matter related to that disclosedin Japanese Priority Patent Application JP 2010-290445 filed in theJapan Patent Office on Dec. 27, 2010, the entire contents of which arehereby incorporated by reference.

What is claimed is:
 1. An image processing device, comprising: ahighlight extracted video creation unit configured to: extract ahighlight video from each video file of a plurality of video files basedon position information associated with the plurality of video files,wherein the position information corresponds to a location ofrecordation of the plurality of video files; and create a highlightextracted video based on the extraction of the highlight video from eachvideo file of the plurality of video files; a highlight extracted videostorage unit configured to store the created highlight extracted videoas one data file; a highlight extraction setting unit configured to seta ratio of a volume of music in a background of the stored highlightextracted video and a volume of an actual sound associated with thestored highlight extracted video; a highlight extracted videoreproduction unit configured to reproduce the stored highlight extractedvideo on a display screen, wherein the reproduction is based on the setratio of the volume of the music in the background of the highlightextracted video and the volume of the actual sound associated with thehighlight extracted video; and a highlight extracted video file outputunit configured to output the reproduced highlight extracted video to adevice connectable to a network, wherein the output of the reproducedhighlight extracted video is based on a user input.
 2. The imageprocessing device according to claim 1, wherein the highlight extractedvideo file output unit is further configured to upload the reproducedhighlight extracted video via the network.
 3. The image processingdevice according to claim 1, wherein the highlight extracted video fileoutput unit is further configured to output the reproduced highlightextracted video to a recording unit of a disk form recording medium, andthe recording unit records the reproduced highlight extracted video onthe disk form recording medium.
 4. The image processing device accordingto claim 1, further comprising: a scenario creation unit configured tocreate a scenario of the highlight extracted video; and a scenariostorage unit configured to store the scenario.
 5. The image processingdevice according to claim 4, wherein the scenario of the highlightextracted video corresponds to time information of each video file ofthe plurality of video files in the highlight extracted video.
 6. Theimage processing device according to claim 1, further comprising anindex creation unit configured to create an index of the one data file,wherein the highlight extracted video file output unit is furtherconfigured to output a user specified data file from the index.
 7. Animage processing method, comprising: extracting a highlight video fromeach video file of a plurality of video files based on positioninformation associated with the plurality of video files, wherein theposition information corresponds to a location of recordation of theplurality of video files; creating a highlight extracted video based onthe extraction of the highlight video from each video file of theplurality of video files; storing the created highlight extracted videoas one data file; setting a ratio of a volume of music in a backgroundof the stored highlight extracted video and a volume of an actual soundassociated with the stored highlight extracted video; reproducing thestored highlight extracted video on a display screen, wherein thereproduction is based on the set ratio of the volume of the music in thebackground of the highlight extracted video and the volume of the actualsound associated with the highlight extracted video; and outputting thereproduced highlight extracted video to a device connectable to anetwork, wherein the output of the reproduced highlight extracted videois based on a user input.
 8. A non-transitory computer-readable mediumhaving stored thereon computer-executable instructions that, whenexecuted by a processor, cause the processor to perform operations, theoperations comprising: extracting a highlight video from each video fileof a plurality of video files based on position information associatedwith the plurality of video files, wherein the position informationcorresponds to a location of recordation of the plurality of videofiles; creating a highlight extracted video based on the extraction ofthe highlight video from each video file of the plurality of videofiles; storing the created highlight extracted video as one data file;setting a ratio of a volume of music in a background of the storedhighlight extracted video and a volume of an actual sound associatedwith the stored highlight extracted video; reproducing the storedhighlight extracted video on a display screen, wherein the reproductionis based on the set ratio of the volume of the music in the backgroundof the highlight extracted video and the volume of the actual soundassociated with the highlight extracted video; and outputting thereproduced highlight extracted video to a device connectable to anetwork, wherein the output of the reproduced highlight extracted videois based on a user input.